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Abstract 

We introduce a relaxation of the notion of tensor rank, called s-rank, and show that upper bounds on 
the i-rank of the matrix multiplication tensor imply upper bounds on the ordinary rank. In particular, if 
the ".s-rank exponent of matrix multiplication" equals 2, then CO — 2. This connection between the .s-rank 
exponent and the ordinary exponent enables us to significantly generalize the group-theoretic approach 
of Cohn and Umans, from group algebras to general algebras. Embedding matrix multiplication into 
general algebra multiplication yields bounds on .s-rank (not ordinary rank) and, prior to this paper, that 
had been a barrier to working with general algebras. 

We identify adjacency algebras of coherent configurations as a promising family of algebras in the 
generalized framework. Coherent configurations are combinatorial objects that generalize groups and 
group actions; adjacency algebras are the analogue of group algebras and retain many of their important 
features. As with groups, coherent configurations support matrix multiplication when a natural combi- 
natorial condition is satisfied, involving triangles of points in their underlying geometry. 

Finally, we prove a closure property involving symmetric powers of adjacency algebras, which en- 
ables us to prove nontrivial bounds on CO using commutative coherent configurations and suggests that 
commutative coherent configurations may be sufficient to prove CO = 2. Altogether, our results show that 
bounds on CO can be established by embedding large matrix multiplication instances into small commuta- 
tive coherent configurations, while avoiding the representation-theoretic complications that were present 
in the group-theoretic approach. 
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1 Introduction 



Determining the exponent of matrix multiplication is one of the most fundamental unsolved problems in 
algebraic complexity. This quantity is the smallest number ft) such that n X n matrix multiplication can 
be carried out using « <B +°( 1 ) arithmetic operations as n tends to infinity. Clearly ft) > 2, and it is widely 
believed that (0 = 2, but the best upper bound known is ft) < 2.3727 (due to Vassilevska Williams lPT8l ). 
The importance of ft) is by no means limited to matrix multiplication, as ft) also describes the asymptotic 
complexity of many other problems in linear algebra and graph theory (see Chapter 16 of (51). 

In the 43 years since Strassen's original paper [16] gave the first improvement on the obvious exponent 
bound ft) < 3, there have been several major conceptual advances in the effort to obtain upper bounds on 
ft), each of which can informally be understood as relaxing the "rales of the game." For example, Bini 
l2l showed that an upper bound on the border rank of a tensor implies an upper bound on its asymptotic 
rank. Indeed, there are useful examples of tensors with border rank strictly smaller than their rank, which 
led to improvements over Strassen's original algorithm. Schonhage [14] showed how to convert upper 
bounds on the rank of the direct sum of several matrix multiplication tensors into an upper bound on ft), 
and his asymptotic sum inequality has played a crucial role in nearly all further advances. Strassen's laser 
method iMTl gave a way to convert non-matrix multiplication tensors (whose coarse structure contains a large 
diagonal, and whose components are all isomorphic to matrix multiplication tensors) into upper bounds on 
ft), and this method was used by Coppersmith and Winograd (H as well as in the recent improvements of 
Stothers HH and Vassilevska Williams lfT8l . 

Here we introduce a further relaxation of the rules of the game, by studying a weighted version of matrix 
multiplication. Instead of computing the product AB of two matrices via 

(AB) i>k Y^AiJij.,. 
j 

we use 

j 

where the coefficients A, j ^ are nonzero complex numbers. Of course, in certain cases weighted matrix 
multiplication is trivially equivalent to ordinary matrix multiplication. For example, if h,j,k can be written 
as OCijpj^Ykj, then weighted matrix multiplication amounts to ordinary multiplication of matrices whose 
entries have been rescaled. However, rescaling does not yield an efficient equivalence for arbitrary weights. 

We capture the complexity of weighted matrix multiplication via a new exponent ft) s , satisfying 2 < 
ft)j < ft). It is the smallest real number for which there exist weights (depending on the dimensions of the 
matrices) such that weighted nxn matrix multiplication can be carried out in n as+ °^ arithmetic operations. 
The "s" stands for "support," because we are dealing with tensors that have the same support as the matrix 
multiplication tensors. 

In Q, we showed how to embed matrix multiplication into group algebra multiplication, and this 
methodology was used in (6l to prove strong bounds on ft). Replacing group algebras with more gen- 
eral algebras has always been an appealing generalization, and indeed the same approach works, except that 
it yields an embedding of weighted matrix multiplication. Thus, it gives an upper bound on co s , rather than 
ft). Prior to this paper, an upper bound on C0 S was of interest only by analogy with ft), and it was not known 
to imply anything about ft) itself. Here, we overcome this obstacle by bounding ft) in terms of ft) v , and we 
develop this embedding approach for a promising class of algebras. 

Our main results are: 
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• We prove that ft) < (3ft) 4 — 2) /2. In particular, if ft) s < 2 + e, then ft) < 2 + (3/2)e, so bounds for ft) s can 
be translated into bounds for ft) with just a 50% penalty. Of course, that penalty is significant when e 
is large, but our bound makes weighted matrix multiplication a viable approach for proving that (0 = 2 
(as then £ = 0). This inequality between ft) and C0 S can be proved using the laser method, but it does 
not seem to have been observed previously We give a direct and self-contained proof in Section [3] as 
well as an explanation via the laser method. We also show that Boolean matrix multiplication has a 
randomized algebraic algorithm with running time n Ws+0 ( l \ which avoids the 50% penalty. 

• We identify adjacency algebras of coherent configurations as a promising family of algebras. Coherent 
configurations are combinatorial objects that generalize groups and group actions; adjacency algebras 
are the analogue of group algebras and retain many of their important features. In particular, each 
adjacency algebra possesses a basis corresponding to an underlying geometry, and weighted matrix 
multiplication can be embedded when the coherent configuration satisfies a combinatorial condition 
involving triangles of points. 

• We prove a fundamental closure property of this class of algebras: any bound on C0 S obtained by 
applying the asymptotic sum inequality to independent embeddings of several weighted matrix mul- 
tiplications can also be proved using a single embedding into a symmetric power of the algebra. 
Symmetric powers of adjacency algebras are themselves adjacency algebras, and this operation also 
preserves commutativity. Our results open the possibility of achieving (0 = 2 using commutative ad- 
jacency algebras, and we conjecture that commutative adjacency algebras suffice. In fact, that would 
follow from either of the two conjectures in |6j. 

A simple pigeonhole principle argument (Lemma 3. 1 in Q) shows that one cannot nontrivially embed 
matrix multiplication into a commutative group algebra. One might expect a similar barrier for commutative 
adjacency algebras, but the pigeonhole argument breaks down in this setting. Indeed, in this paper we prove 
nontrivial bounds on ft) using commutative adjacency algebras in Theorem l5.6l by applying our machinery 
to the constructions from Q (although we do not improve on the best known bounds). We should note that 
the simultaneous triple product property from [6] previously showed that one could avoid noncommutativity 
at the cost of having to deal with several independent embeddings. One could return to the setting of a single 
embedding using the wreath product construction (Theorem 7.1 in [6]), but this reintroduced noncommu- 
tativity, whereas working with coherent configurations rather than groups, as we do in this paper, avoids it 
completely. 

The advantage of commutativity is that obtaining exponent bounds then amounts to a familiar type of 
task: embed as large an object (here, a matrix multiplication instance) as possible into as small an object as 
possible (here, a coherent configuration, with "size" measured by rank). By contrast, the noncommutative 
case involves a third quantity, namely the dimensions of the irreducible representations of the algebra. 

2 Preliminaries and background 

We define [n] = {1,2, . . . ,n}. 
2.1 Tensors 

Our results will all be stated in terms of tensors. Recall that tensors are a generalization of vectors and 
matrices to higher orders. Tensor products of vector spaces form an elegant algebraic setting for the theory 
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of tensors, but we will adopt the more concrete approach of representing tensors as multilinear forms. For 
example, the matrix with entries A, j corresponds to the bilinear form Y^u^ij^iyp where je, and yj are formal 
variables, and we can represent a third-order tensor as Y,i j kAij,kXiyjZk- We will use hats to make it clear 
which symbols denote formal variables. Applying invertible linear transformations to the sets of variables 
(here, {x,}, {yj}, and {z k }) yields an isomorphic tensor, but we cannot mix variables from different sets. 

The direct sum T ffi T' of two tensors is simply their sum, if they have no variables in common (otherwise, 
first change variables to remove any overlap). For the tensor product T ®T\ if T = Ei /* Ti,jJc$$jZk an d 
T' = ld,m,n Km^fVmWn, then 

T(&T'= ^ Tij^T^ mn fi^Sj^ m tk,n, 
i,j,k,l,m,n 

with new variables r,-^, Sj m , and t kn . In other words, we simply take the product of T and T but combine 
the variables as illustrated above (e.g., XjUg becomes r^). The direct sum and tensor product are defined 
only for tensors of the same order, and they preserve that order. 

The rank R(T) of a tensor T is one of its most important invariants. A nonzero tensor has rank 1 if it 
is the product of linear forms, and rank r if it is the sum of r rank 1 tensors but no fewer. In other words, 
Hi.j.k TijftXifjZk has rank at most r if there are linear forms ttt(x), Pe(y), and jf (z) such that 

r 

T i,j,kx$jZk = £ a e(x)Pe(y)Ye(z)- 

i,j,k t=\ 

Tensor rank generalizes the concept of matrix rank, but it is more subtle. While matrices can be brought 
into a simple canonical form (row echelon form) in which their rank is visible, tensors cannot, because the 
symmetry group acting on them has far too low a dimension compared with the dimension of the space of 
tensors itself. Indeed, computing tensor rank is NP-hard |9). 

2.2 Matrix multiplication in terms of tensors 

The matrix multiplication tensor (£,m,n) is the tensor 

£ m n 

i=i j=\k=i 

Note that the coefficient of Zk,i singles out the x~i,jyj,k terms that occur in the (i,k) entry of the matrix 
product. It is easy to check that (£,m,n) <S> (£',m',n') = (££',mm',nn'}, which amounts to the assertion that 
block matrix multiplication computes the matrix product. 

A low-rank expression for (£,m,n) specifies an efficient bilinear algorithm for computing the product 
of £ x m and m x n matrices. In particular, it follows that (£mn) m / 3 < R((£,m,n)) (Proposition 15.5 in |5l). 

In fact, although we have defined a> in terms of arbitrary algebraic algorithms, it is completely charac- 
terized by rank via 

(0 = infjr G E : R{(n,n,n)) = 0(n T )} 

(Proposition 15.1 in [5 ]). In other words, bilinear algorithms have the same exponent as arbitrary algebraic 
algorithms. Thus, the entire subject of fast matrix multiplication can be reduced to bounding the rank of 
matrix multiplication tensors. 

Schonhage's asymptotic sum inequality [14] states that 

{£ 1 m 1 n l ) a> / 3 + ■■■ + (£ k m k n k )^ 3 < R({e u mi,m) © •••© (£ k ,m k ,n k )), (2.1) 



3 



and furthermore that the same holds for border rank (a relaxation of the notion of rank which will not play an 
important role in this paper). Thus, an unexpectedly efficient method for carrying out several independent 
matrix multiplications yields a bound on CO. 

See HI for further background on tensors, matrix multiplication, and algebraic complexity in general. 
It is important to keep in mind that the tensor manipulations all have implicit algorithms behind them. In 
principle one could dispense with the tensor formalism completely, but it plays a valuable role in focusing 
attention on the central issues. 

3 Bounds on the matrix multiplication exponent via s-rank 

In this section, we show that an upper bound on what we call the "support rank" — or s-rank — of a ma- 
trix multiplication tensor implies an upper bound on CO. The support supp(r) of a tensor T is the set of 
monomials that have nonzero coefficients. Of course this depends on the choice of basis and is therefore 
not an isomorphism invariant, and the same is true for concepts like s-rank that are defined in terms of it. 
However, basis dependence is not a difficulty in algebraic complexity. After all, any computational problem 
must specify a choice of basis for use in input and output, and writing a tensor as a multilinear form already 
involves an implicit choice of basis (the choice of variables). 

Definition 3.1. The s-rank R S (T) of a tensor T is the minimum rank of a tensor T for which supp(r) = 
supp(r'). 

Clearly s-rank can be no larger than rank. Here is a simple example that shows that s-rank can be 
dramatically smaller than both rank and border rank: 

Proposition 3.2. The nxn matrix J — I, where J is the all ones matrix and I is the identity matrix, has rank 
n and border rank n, but s-rank equal to 1. 

Proof. Rank and border rank coincide for matrices (the matrices of rank at most r are characterized by 
determinantal conditions and thus form a closed set), and J — I has rank n. However, consider the rank 1 
matrix M defined by Mij = C ; » where £ is a primitive n-th root of unity. Then M — J has the same support 
as J — I. Because M and J are both rank 1 matrices, the s-rank of J — I is at most 2. It is also easy to see that 
no matrix with the same support as J — I has rank 1, so the s-rank is exactly 2. □ 

On the other hand, border rank can be smaller than s-rank, so these two relaxations of rank are incom- 
parable: 

Proposition 3.3. The tensor T = xoyoZo +-%yi£i +xiyoZi has border rank 2 and s-rank 3. 

Proof. We refer to Blaser's notes H p. 31] for the simple proof that the border rank is 2. To show that 
the s-rank is at least 3, we mimic his proof via the substitution method that the (ordinary) rank is 3. In a 
decomposition of any tensor T' with the same support as T into the sum of rank one tensors, one of the 
rank one tensors must depend on x\ . We can make this tensor zero by substituting a scalar multiple of jco for 
x\ . After this substitution, T' still depends on y\ , so there is another rank one tensor in the decomposition 
that depends on y\. We can make this tensor zero by substituting a scalar multiple of % for y\. After both 
substitutions, T' still depends on zo, so there must be at least one more rank one tensor in the decomposition. 
The corresponding s-rank upper bound of 3 is trivial. □ 
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Like ordinary rank, s-rank is subadditive and submultiplicative in the sense that for tensors T and T', 
we have R S (T T') < R S (T) +R S (T') and R S (T (g> T') < R S (T)R S (T'). For matrix multiplication tensors, we 
have R s ((£,m,n)) = R s ((£' ,m' ,n')) for every permutation (£',m',n') of (£,m,n). In analogy to the exponent 
of matrix multiplication ft), we define C0 S , the s-rank exponent of matrix multiplication, as follows: 

Definition 3.4. The s-rank exponent of matrix multiplication, denoted (o s , is defined by 

ft), = inf{r € R : R s ((n,n,n)) = 0(n T )}. 

By comparison, the exponent ft) can be defined in the same way, with ordinary rank replacing s-rank in 
the above expression. Since every tensor having the same support as (n,n,n) has n 2 linearly independent 
slices, R s ((n,n,n)) > n 2 , and thus 2 < C0 S < ft). 

As one would expect, an s-rank upper bound implies an upper bound on (o s . Here is the s-rank version 
of the standard proof: 

Proposition 3.5. For all £,m,n, we have (£mn) w '/ 3 <R s ({£,m,n)). 

Proof. Let r = R s ((£,m,n)) and M = Imn. By symmetrizing, we have R S ((M,M,M)) < r 3 , and then for all 
N > 1, by padding to the next largest power Af of M, 

R S ((N,N,N)) < R s {{M l ,M l ,M 1 )) < r 3i = (M i f logMr = 0(N 3l ° s " r ). 

Thus, ft) 4 < 31og M r, from which the theorem follows. □ 

We note that one can define the border s-rank of T to be the minimum border rank of tensors with the 
same support as T, and then by using Bini's argument [2], the above proposition holds with border s-rank in 
place of s-rank. 

Whereas an upper bound on the rank of a matrix multiplication tensor implies a bilinear algorithm for 
matrix multiplication, an upper bound on the s-rank implies a bilinear algorithm for a weighted version of 
matrix multiplication: given matrices A and B, the algorithm computes values 

Ci,k = ^^i,j,k^i,jRj,k, 

j 

where the weights A; are certain non-zero scalars (depending on the construction used to attain a low s- 
rank). In other words, each entry of the result matrix C is a weighted inner product, with different weightings 
for the different inner products. There seems to be no obvious transformation to remove these weights. 

As noted above, 2 < ft) s < ft), so upper bounds on ft) imply upper bounds on ft) v (and CO = 2 implies 
(O s = 2). Theorem 1 3 . 6 1 below shows that upper bounds on co s imply upper bounds on ft), and indeed ft) s = 2 
implies (0 = 2. Thus s-rank is a useful relaxation of rank, when trying to bound the exponent of matrix 
multiplication. 

Theorem 3.6. The exponents ft) and ft) s satisfy ft) < (3co s — 2) /2. 

In other words, ft) s < 2 + e implies ft) < 2 + (3/2)e. In particular, if co s = 2 then (0 = 2. 

Proof. By the definition of ft) v , we have R s ((n,n,n)) = n Ws+ °^\ For a given value of n, let T be the trilinear 
form corresponding to this (weighted) n x n matrix multiplication: 

= L hj,k x uyj,kZk,i 

i,j,ke[n\ 
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with ^ Xij{ € C for all i,j,k. Let 

SCA„ = {(ji,J2,*3) :si,S2,S3 G [«] and si + S2 + S3 = w + 2} 

be a triangle-free set, as denned in Section 6.2 of 0. Such a set has the property that if s,t,u 6 5 satisfy 
= ?i , ?2 = "2, and M3 = 53 then 5 = f = m. In [6] we gave a simple construction of triangle-free sets S with 
\S\ = n 2 ~ o( > l \ Let 7" be the trilinear form corresponding to \S\ independent n 2 x n 2 matrix multiplications; 
i.e., 

Us,i,jV s ,j Jewes- 
ses, i,j,ke[n] 2 

We will show that T' is a restriction of the tensor power 7 1 ® 3 , which is given by 

T — ^■i[J[,k\^-i2,j2,k2^'i3 1 j3,kj^ijyj,kZk,i- 

In other words, we will show that T' can be obtained by substituting variables in T® 3 , which implies that 
R(T') < R(T® 3 ) . To do so, define (for s,t,u € S and ,j,f ,k,k' € [n] 2 ) 

U s ,i,f = Kj^Hhh^^ufvA) 

v t j,k> = K,h&y{h,h,hUK&#i) 

Wu,k,i' = K[ ,ui,h %i,M2,fe),(ii,4,"3) 

and set the x,y,z variables not mentioned in these equations equal to zero. Under this change of variables, 
we will see that T® 3 becomes exactly the tensor T'. To check this, we must verify that upon substitut- 
ing the u,v,w variables for the x,y,z variables in J® 3 according to the above formulas, the coefficient of 
u s jj'Vtj,k'Wu,k,i' is lifs = t = u, i = i' , j = f, and k = k', and it is otherwise. Since the support of T® 3 is 
the same as the support of (n 3 ,« 3 ,n 3 ), the monomial 

% ,h&),fa ,A ,fz)y{h ,h ,72),(*' 1 ,f2,*2)%i ,«2,fe),(i},^,»3) 

in J® has a non-zero coefficient if and only if 

(S1J1J2) = {hJuh) 
(k[,t 2 ,k 2 ) = (ki,u 2 ,k 2 ) 
(i'i,i 2 ,m) = (11,1*2,^3). 

This happens if and only if i = i', j = /, k = k' , s\ = t\, t 2 = u 2 , and U3 = S3, and by the definition of a 
triangle-free set the last three conditions imply s = t = u. The coefficient in 7 1 ® 3 of 

*{h ,'2,.«3),(.<i,;'i ,h)y(s\ ,j\ ,h).{h ,h,^) 

is ^i'i,Ji,fei^2ji,J2^3j2,fe' wn i cn exactly corresponds to the ^i 2 j' v s 2 ^t 3 j 2 >m fa factor from the definition of 
w,v,w, so the coefficient of u s ,ijv.fj,k w s,k.i after the substitution is 1. 

Thus the ordinary rank of the direct sum of \S\ = n 2 ~"^ independent n 2 x n 2 matrix multiplications is 
at most (n <0s+o ( 1 A , and applying the asymptotic sum inequality (12.11 ). we get 

n 2-o{l) n 2m < ( n « s + (l))3_ 
Taking logarithms and letting n go to infinity, we get 2 + 2(0 < 3(O s , as desired. □ 
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Theorem 13.61 can also be proved using the laser method, in particular using Proposition 7.3 from ifTTl 
(Proposition 15.32 in 0), although this consequences does not seem to have been observed in the literature. 
Here is a sketch of the proof. By definition, there exist tensors having the same support as (n,n,n), with 
R(T) = n CDl+0 ( 1 ). Adopting the language of @, such a tensor has a direct sum decomposition D whose 
D-support is isomorphic to 1) and whose D-components are each isomorphic to in, l,n) (it is a special 
feature of an outer-product tensor, which has only a single 1 in each slice, that all tensors with the same 
support are isomorphic). Proposition 15.32 in [5] then implies that n 2 n 2co < (n a * +o( V) , which yields the 
same bound as Theorem l3.6l 

It is an interesting open problem to improve the conclusion of Theorem [33] to ft) < (O s . In the preceding 
paragraph, the D-component isomorphism being used is very special (it corresponds to a diagonal change 
of basis), so one might hope to avoid the loss coming from machinery that handles arbitrary isomorphisms. 

In fact, this loss can be avoided entirely when one is interested in the simpler problem of Boolean matrix 
multiplication, i.e., matrix multiplication over the Boolean semiring with "and" as multiplication and "or" 
as addition. The next theorem describes how to use weighted multiplication directly to obtain an algebraic 
algorithm for Boolean matrix multiplication. 

Given nxn Boolean matrices A and B, let A' be the obvious lift of A to a 0/ 1 complex matrix, and define 
B' the same way but with a random choice of 1 or 2 for each nonzero entry. 

Theorem 3.7. There is an algebraic algorithm running in n Ws+0 ^ operations that computes from A',B' an 
nxn matrix C with the following property: the (i,j) entry ofC is if the (i,j) entry of the Boolean matrix 
product of A and B is 0; otherwise it is non-zero with probability at least 1/2. 

The procedure may be repeated O(logrc) times to obtain all entries of the Boolean product of A and B 
with high probability. 

Proof. Using a bilinear algorithm, one can compute a suitably weighted product of A' and B' in « (Bi +°( 1 ) 
operations. We get a result matrix whose entry is 

e 

where Xi^j ^ 0. When the (i, j) entry of the Boolean matrix product of A and B is zero, this value is clearly 
also zero; otherwise, it equals Y,leL^it,j r £ f° r a nonempty set L and each r^ chosen randomly from {1,2}. 
For a given I G L, there is a unique value of ri making this sum zero, so the probability that it vanishes is at 
most 1 jl. □ 

If the weights arising in the above proof are all positive (as they are for all the s-rank bounds we derive 
in this paper), then no randomness is needed, as A' and B' can both be taken to be the obvious lifts of A and 
B to 0/1 matrices. 

Finally, we note that all of the manipulations used in the matrix multiplication literature for converting 
bounds on the rank of certain "basic" tensors into bounds on the rank of the matrix multiplication tensor 
also work with s-rank in place of rank. So, for example, s-rank bounds on the partial matrix multiplication 
tensor of Bini, Capovani, Lotti, and Romani [3], the basic tensor used by Schonhage [14], the basic tensor in 
Strassen's laser method paper fTTH . or any of the basic tensors introduced by Coppersmith and Winograd (H 
eventually yield an s-rank bound on a matrix multiplication tensor by simply following the known proofs. 
However, for most of these basic tensors with explicit tensor decompositions, there are matching lower 
bounds on the rank via the substitution method (e.g., the proof of Proposition 13.31) . Substitution method 
lower bounds also prove lower bounds on s-rank, so there does not seem to be an opportunity for an easy 
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improvement from switching to s-rank. However, an improvement by switching to border s-rank might be 
possible. As a concrete example, we do not know whether the border s-rank, or even just the s-rank, of 
(2,2,2) is 6 or 7. 

4 Matrix multiplication via coherent configurations 

In this section, we describe how to embed matrix multiplication into algebra multiplication. To do so, it 
is helpful to have a basis with considerable combinatorial structure. As mentioned in the introduction, 
adjacency algebras of coherent configurations are a promising family of algebras to use here. In Subsec- 
tions l4.2l and l4.3[ we review the basic theory of coherent configurations and their adjacency algebras, and in 
Subsection 14.41 we specialize our general theory to this setting. 

4.1 Realizing matrix multiplication in algebras 

We can bound the s-rank of matrix multiplication by restricting the structural tensor of an algebra. Let A 
be a finite-dimensional complex algebra, and let u\, . . . , u r be a basis for A. Then there are coefficients 
such that 

r 

U{Uj = ^ ^i,j,k u k', 
k=\ 

they are called the structure constants of A with respect to this basis. The structural tensor is the trilinear 
form 

k,j,kXiyjZk- 

ij,k 

It is isomorphic to the multiplication tensor (i.e., the element of A* <g> A* <g>A corresponding to the multipli- 
cation map from A(g>A to A). More generally, if we use any three bases u\,. . . ,u r , v\, . .. ,v r , and wi,...,w r 
for A and define the coefficients by 

r 

U i V j = 

k=l 

then the corresponding tensor is isomorphic to the structural tensor. 

Definition 4.1. Let A be an r -dimensional complex algebra with structure constants Ai,j,k corresponding to 
some choice of bases. We say A realizes (£,m,n) if there exist three injective functions 

a: [£]x [m] -)■ [r], /3 : [m] x [n] -)■ [r], 7: [n] x [£] — > [r] 

such that 

h a {a,b')fi(b,c'),Y(c,a') 

if and only ifa = a', b = b', and c = c 1 . 

Note that this definition depends on the choice of basis. We will typically suppress the choice of basis 
in the notation, because the algebras we deal with later in the paper will always come with a standard basis. 

Proposition 4.2. If an algebra A realizes (£,m,n), then the s-rank of (£,m,n) is at most the rank of the 
structural tensor for A. 
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Proof. Suppose A realizes (£,m,n) via a, j8, 7, and consider the structural tensor 

Mj,kXiyjZk- 

Define u a p = x a i a m, $b,d — yp(b,c')i an d Wc,a! = 2y(c,a')' furthermore, set x ( - = when i is not in the image 
of a, yj = when 7 is not in the image of j3, and ik = when & is not in the image of 7. Under this change 
of variables, the structural tensor becomes 

^a{a,b'),P{b,c'),y(c,a')^b' Vb,c> W c ^ a i, 

a,a' ,b,V ,c,d 

and by assumption the terms vanish unless a = a! ', b = b' , and c = c' . Thus, 

Y h a (a,b) ,p {b,c).y(c,a) ^a.b Vbx W c ^ a 
a,b,c 

has rank at most that of the structural tensor. This new tensor is a weighting of the matrix multiplication 
tensor (£,m,n), so the s-rank of (£,m,n) is at most the rank of the structural tensor. □ 

Note that this proof in fact gives a very simple algorithm for reducing a weighted matrix multiplication 
to an algebra multiplication, along the lines of the reduction in Q. 

Recall that an algebra is semisimple if it is a product of matrix algebras. In other words, it is semisimple 
if there are character degrees d\,...,d t so that 

A = C^' xrfl x • ■ • x C rf,xrf ' 
In that case, the structural tensor is isomorphic to (d\,d\,d\) ® ■ • • ® (d t ,d t ,d t ). 
Proposition 4.3. If a semisimple algebra A with character degrees di,...,d t realizes (£,m,n), then 

(£mn) m ^ 3 <df + --- + df. 

This proposition also involves a natural algorithm, which reduces a weighted matrix multiplication to a 
collection of unweighted matrix multiplications. 

Proof. For each e > 0, there is a constant C such that R((d,d,d)) < Cd a+e for all d. It follows that 

{lmn) a ^ < R s ((£,m,n)) < Cdf +e + • • • +Cdf >+e , 

but the C and e are problematic. To remove them, we will use the trick of computing the asymptotic rank 
for high tensor powers. The algebra A® realizes a weighted version of (t,m,n)® = {£ ,m ,n ), and it 
has character degrees given by Af-fold products . . . d[ N . Thus, 

(£mnf m ^ 3 < C (df +e + ■■■+ d? +e f . 
Now taking Af-th roots and letting N tend to infinity yields 

(£mn) a ^ 3 <df +e + ---+df +£ , 
and because this holds for all e > it also holds for e = by continuity. □ 
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Definition 14.11 generalizes the triple product property from Q. To see why, suppose A is the group 
algebra of a finite group, and choose the group elements themselves as a basis. Then a(a,b'), fi(b,c'), and 
y(c,a') correspond to group elements g a y, h\,^ and k a / }C such that 

ga,b' h bx J = k a',c (4-1) 

if and only if a = a', b = b', and c = c' . We wish to find group elements s a ,tb,u c such that g a ,b = s a t^ 1 , 
hb,c = tbu~ l , and k ac = s a u~ l ; then {s a },{tb},{u c } satisfy the triple product property from [7]. To find 
these group elements, fix bo, and let s a = g a ^ and u c = c . Then s a u~ l = k ac automatically. Furthermore, 
(14.11) implies that g~ l bQ g a M = n b,ch^ c , with this group element being independent of a and c. Calling it % 
completes the construction. 

4.2 Coherent configurations 

Coherent configurations are remarkable structures that unify much of group theory and algebraic combina- 
torics iTTOl ITTL IT2ll . A coherent configuration of rank r is a finite set ^ , whose elements are called points, 
with a partition of ^ 2 into subsets R\ ,/?2, . ■ ■ ,R r called classes such that 

1. the diagonal {(x,x) : x G c to} is the union of some of the classes, 

2. for each i G [r] there exists i* G [r] such that RJ = Ry , where 

R*={(b,a) : (a,b) G /?,-}, 

and 

3. there exist integers p\, for i,j,k G [r] such that for all x,y G ^ with (x,y) G Rk, 

#{z G : (jc,z) G and (z,y) G *y} = p^. 

We say ^ is symmetric if /?* = /?; for all i and commutative if pfy = ( - for all i,j,k. (Symmetry implies 
commutativity, but not vice versa.) The numbers p\ ■ are called the intersection numbers of the configuration. 
The configuration is an association scheme if the diagonal is itself one of the classes. 

Every finite group G defines an association scheme, with G as its set of points and G 2 partitioned into 
subsets R g = {(h,hg) : h G G} with g G G. Then for g,h,k G G, 




1 if gh = k, and 
otherwise. 



The intersection numbers encode the multiplication table of the group, so the group and the corresponding 
association scheme are fully equivalent structures. Note that this association scheme is commutative iff G 
is, while it is symmetric iff g = g^ 1 for all g G G. One can show that an association scheme comes from a 
group in this way if and only if all its intersection numbers are at most 1 . 

More generally, suppose G acts on a finite set X. Then partitioning X 2 into the orbits of G under 
the diagonal action defines a coherent configuration, called a Schurian coherent configuration. It is an 
association scheme iff G acts transitively on X. 
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Many important examples in combinatorics fit into this framework. For example, the Hamming scheme 
consists of the points in {0, 1}" with classes defined by Hamming distance. From a group-theoretic perspec- 
tive, it is the Schurian association scheme defined by the action of the semidirect product S n x (Z/2Z)" on 
{0, 1}", although this formulation is overkill for most purposes. 

If G acts transitively on X, then we can identify X with G/H, where H is the stabilizer of a point in X. 
Note that G/H is not a group unless H is a normal subgroup, but it is always an association scheme. In 
certain cases, called Gelfand pairs (G,H), the quotient G/H is a commutative association scheme (although 
the groups G and H will typically not be commutative). For example, this occurs for the Hamming scheme. 

There are also numerous combinatorial examples of association schemes and coherent configurations 
that do not come from symmetry groups. For example, strongly regular graphs are the same thing as sym- 
metric association schemes of rank 3. More generally, every distance-regular graph is an association scheme 
when the classes are defined by the graph metric. Some of these graphs are Schurian association schemes, 
but many are not. 

A fusion of a coherent configuration ^ is a configuration c €' with the same set of points and with the 
classes of So' all given by unions of classes of . (Note that this must be done carefully, since taking 
arbitrary unions will generally not yield a coherent configuration.) Another important construction is the 
direct product: given two coherent configurations ^ and their product ^ x has the direct product of 
their point sets as its point set, with the class of (c\ , c\ ) and (c2,c' 2 ) determined by the class of {c\ , c<i) in ^ 
and that of (c'^Cj) in c to" . The symmetric power Syn/'rf is the fusion scheme formed by fusing the classes 
of the direct power ^* under the action of the symmetric group St on the factors. 



4.3 The adjacency algebra 

Every coherent configuration has an associated algebra, which plays the same role as the group algebra of a 
group. Let A\ , . . . ,A r be the adjacency matrices of the relations R\,...,R r . In other words, A,- is indexed by 
c €, with 

1 if (x,y) € Ri, and 
otherwise 



{M)x,y — 



for ij 6 ^. The adjacency algebra C[^] of c € is the complex algebra generated by these adjacency matri- 
ces. (Note that it contains the identity because the diagonal is a union of classes.) An easy calculation shows 
that 

A t Aj = Y,PtA, 
k 

so C[¥?] is spanned by A\, . . . ,A r . It is a commutative algebra if and only if is commutative. 

The adjacency algebra is closed under the conjugate transpose, so it is a semisimple algebra. Thus, there 
exist character degrees d\,...,dk such that 

^ ^di xd\ x . . . x (^d k xdk 

Of course, d\ H \-df must equal the dimension of C[^], which is the rank of ^ . The adjacency algebra 

of a commutative coherent configuration of rank r is isomorphic to C. 
The structural tensor of Cf'rf] is 

iJMlr] 
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but (as we will see shortly) it is often convenient to use 

Lit* /> 
PijXiyjZk 

instead. This isomorphic tensor simply amounts to reordering the variables 2k- Note that the rank r of the 
coherent configuration is not necessarily the same as the rank of the structural tensor: they are equal if and 
only if the configuration is commutative. 

4.4 Embedding matrix multiplication into an adjacency algebra 

Let ^ be a coherent configuration of rank r, with notation as in the previous subsection. 

Definition 4.4. Three classes i,j,kform a triangle if there exist points x,y,z such that (x,y) £ /?,-, (y,z) £ Rj, 
and (z,x) £ Ru- 
in terms of intersection numbers, classes i,j,k form a triangle iff pfj > 0. (Note that we use k* instead 
of k to switch the order of x and z.) This is why we prefer to use k* instead of k in the structural tensor: 
otherwise, the cyclic symmetry among x,y,z is broken. 

Definition 4.5. A coherent configuration ^€ of rank r realizes (£,m,n) if there exist three injective functions 

a: [£]x [m] ->■ [r], /3 : [m] x [n] ->■ [r], y: [n] x [£] -> [r] 

such that a(a,b'),p(b,c'),y(c,a') form a triangle iff a = a', b = b' , and c = d . 

Of course this definition assumes a fixed numbering of the classes in % '. It amounts to the general 
definition of realization in an algebra, specialized to our choice of structural tensor. 

Example 4.6. As a simple example, let ^ be the coherent configuration on n points for which every pair 
of points defines a distinct class. If we index the classes with pairs of points, then (a,b r ), (b,c'), and (c,a') 
form a triangle if and only if a = a', b = b', and c = c', so C[^] trivially realizes (n,n,n). As one might 
expect from such a trivial example, the embedding yields no benefit for matrix multiplication, because in 
fact C[««f] = C nxn . 

In the next section we will construct less trivial examples. In the meantime, we note the following 
proposition, which works out the conditions for a coherent configuration arising from a group action to 
realize matrix multiplication. 

Proposition 4.7. Let G be a finite group acting on a setX, and let be the corresponding Schurian coherent 
configuration. Suppose there exist subsets A, B,C C X such that for all f,g,h&G with fgh = 1 and all a&A, 
b and c € C, 

if fa £A,gbe B, and he G C, then fa = a, gb = b, and he = c. 
Then <*f realizes (|A|, \C\). 

Proof. Recall that the classes of c € are the orbits of G on X 2 . If we identify A with [\A\], etc., then we realize 
(|A|, \C\) via maps a,j8,7 such that for a £ A and b' £ B, a(a,b') is the orbit of (a,b') in X 2 , etc. We 
wish to show that the classes of (a,b'), (b,c'), and (c,a') form a triangle if and only if a = a', b = b', and 
c = c' (where a, a' £ A, b, b' £ B, and c,c' £ C). Saying they form a triangle means there exist x,y,z £ X and 
s,t,u £ G such that (x,y) = (sa,sb'), (y,z) = (tb,tc ! ), and (z,x) = (uc,ua'). If we set / = u~ l s, g = s~ l t, 
and h = t~ l u, then fgh = 1 and fa = a', gb = b' , and he = c' . Now by hypothesis we have a = a 1 ', b = b', 
and c = c', as desired. □ 
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If we let G act on itself by left translation, then the hypothesis of Proposition I4.7l simply asserts that A, 
B, and C satisfy the triple product property from [7]. Thus, the proposition gives a natural generalization of 
the triple product property from groups to group actions. 

5 Simultaneous embeddings and symmetric powers 

Our best construction techniques so far are all based on realizing several independent matrix multiplications 
simultaneously; this was called the simultaneous triple product property in Q. In a coherent configuration, 
the definition amounts to the following (and of course one can give an analogous definition in any algebra): 

Definition 5.1. A coherent configuration ^ of rank r realizes ©,■(£,-, 7n,-,n,-) if there exist injective functions 

Ok : [ii] x [»!,•] [r], /3, : [m,-] x [m] -> [r], yr. [n,-] x [n£i] -> [r] 
such that OCi(a,b'), [5j(b,c'),Yk(c,a') form a triangle iffi = j = k and a = a', b = b', and c = c'. 
If realizes (l\ ,m\ ,ni) © • • ■ © (^/t,mfc,%) and T is its structural tensor, then 

R s ({t u m 1: m) ® • • • ® (£ k ,m k ,n k )) < R(T). 
One can imitate the proof of the asymptotic sum inequality to show that 

(£ imini ) 0,5/3 + • • • + (£ k m k n k ) as/3 <R s ({£ u m l ,n l )e---e (£ k ,m k ,n k )), (5.1) 

from which one can deduce bounds on G) s . Instead, in this section we will develop an efficient algebraic 
method to combine these independent matrix multiplication realizations into one. It will yield the same 
bounds, but also show that this bound is achieved by realizing a single matrix multiplication in a coherent 
configuration. First, we give an example. This example is extremal, because it realizes the direct sum of 
copies of (n,n,n) via a coherent configuration of rank n 3 , and this cannot be done with rank less 
than n 3 ~°^ (because the images of the embeddings must be disjoint). If the coherent configuration were 
commutative, then we could conclude that (0 = 2, but it is far from commutative. 

Example 5.2. Let 'W be the coherent configuration corresponding to the diagonal action of Z/«Z on (Z/«Z) 2 , 
and let S C Z/nZ be a set of size |5| = n 1 ^"^ containing no three-term arithmetic progression [13 ]. We can 
index the classes in ^ as 

R {a,b,c) = {(( s ^ + a ), (s + a + b,s + a + b + c)) : s e Z/«Z} ; 

with a,b,c G Z/nZ. Then ^ realizes (Bi^s(n,n,n) via maps oc r , /3, , Ji defined for i G S by 

CCi(x,y) = (x,i-x,y) 

fy(y,z) = (y,i-y,z) 

Yi(z„x) = (z,-2i-z„x). 

Specifically, it is not hard to check that (x,i—x,y'),(y,j — y,^), (z, —2k — z,x') form a triangle if and only if 
x = x',y = y', z = z 1 , and i + j = 2k (in which case i = j = k because S contains no three-term arithmetic pro- 
gressions). However, this example does not prove any nontrivial bound on ft), because in fact the character 
degrees of are all equal to n (repeated n times). 
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As promised, we now give a constructive proof of (15.11) . The proof converts a coherent configuration that 
realizes several independent matrix multiplications into a single coherent configuration that realizes a single 
matrix multiplication. Moreover, the resulting coherent configuration is commutative if the original one was. 
Because the proof actually constructs a coherent configuration rather than just deducing the bound on (O s , we 
can use it to obtain commutative coherent configurations (even association schemes) that prove nontrivial 
bounds on ft). This establishes one of the main points of the paper: that the non-commutativity that was 
necessary in the group-theoretic approach can be avoided in the generalization to coherent configurations. 

We also find that a consequence of either of the two main conjectures of [6 ] is that commutative coherent 
configurations (even association schemes) suffice to prove (0 = 2. This raises our hope that one could find 
commutative coherent configurations of rank n 2+ °^ that realize (n,n,n) and thus prove (0 = 2. 

The main idea of the proof is to take symmetric powers, as described next: 

Theorem 5.3. Let ^ be a coherent configuration of rank r that realizes ®f =1 (^/,m,-,nj). Then the symmetric 
power Sym k< rf realizes (Y[i^hY[i m i,Y\i n i) and has rank ( r+k . 1 )- 

Proof. The classes Rj of the &-fold direct product of are indexed by vectors / € [r] k . The symmetric 
group S k acts on [r] k by permuting the k coordinates, and the orbits of this action naturally correspond to the 
fc-multisubsets of [rj. Recall that Synr^ is the fusion configuration with a class for each orbit; i.e., for each 
&-multisubset S of r, we have a class R' s that is the union of Rj over all / in the orbit corresponding to S. The 
rank of Syrn^ is the number of distinct orbits (equivalently, the number of distinct &-multisubsets of [r]), 



which is 

Set L = Yliii, M = Yltnii, and N = Yli n i- Now, ^* realizes (L,M,N), so there exist injective functions 



where ^realizes ® k i=x (£,-, m,- 3 n,-) via a,, j8;, 

We claim that in fact a, j8, y are injective even in the fusion configuration, where we collapse the orbits. 
For suppose that a(A,B) = na(A',B') for some % £ S k . Then n must be the identity since the maps a, have 
disjoint images in [r] (this follows immediately from Definition 15. II) . and then by injectivity of a, we have 
(A,B) = (A',B'). The same holds for j3 and y. 

Moreover, the orbits of a(A,B'),p(B,C'),y(C,A') form a triangle in Sym k( tf iff A = A' , B = B' , and 
C = C'. For suppose there exist points X,Y,Z and permutations 711,712)^3 £ Sk for which (X,Y) £ Rj, 
(Y,Z) e Rj and (Z,X) G R K , where / = ni(x(A,B'), J = n 2 P(B,C'), and K = 7i 3 y(C,A'). Then we must 
have 7Ti = 7^2 = 7C3 because ai(Ai,B' j ),pj(Bj,C l j),yi ( (Ck,A' k ) cannot form a triangle unless i = j = k, and then 
A' = A, B = B' and C = C' follow from the fact that these equalities hold for each coordinate (by properties 
of a,, Pi, 7,). Thus Sym* c € realizes (L,M,N), as claimed. □ 

Corollary 5.4. Let ^ be a commutative coherent configuration of rank r that realizes ©f =1 {lu «,-,«,•}. Then 
symmetric powers of direct powers of^ prove the bound 



a:[L]x [M] -»■ [r] k , j3 : [M] x [N] -> [r] k , y: [ 



[N] x [L] -+ [rf 



satisfying the conditions of Definition I4.lt specifically, 



a(A,B) = (a,i{Ai,Bi),...,a k (A k ,B k )) 
P(B,C) = (p 1 (B l ,C l ),...,p k (B k ,C k )) 
y(C,A) = (y 1 (C u A 1 ),...,y k (C k ,A k )), 
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More precisely, they come arbitrarily close to this bound. 

Proof. By taking direct powers, & realizes ® Ie[k] , {Uje[t} h } , Uje[t] m ij > Uje[t] n h ) ■ Setting L = \{ iek l u M = 
Yliek m i an d N = Yli€k n i> we have by Theorem [53] that Sym kc ^' t realizes 

(L tk "\M tk "\N tk " 1 ) 

and has rank ( r +k , _1 ) . By Proposition 13 . 5 1 we have 

where the last inequality uses the fact that k < r. Taking tk r -th roots and letting t go to infinity, we obtain 
the bound (LMN) m ^^ < r/k. □ 

By weighting the independent matrix multiplications appropriately, we find that the geometric mean can 
be replaced by the arithmetic mean, to obtain a bound on co s identical to the asymptotic sum inequality (12.11) : 

Theorem 5.5. Let ^ be a commutative coherent configuration of rank r that realizes ®f =1 (£{, mi,n{). Then 
symmetric powers of direct powers oft? prove the bound Y 1 i(^i m i n i) Ws ^ — r - 

Proof. Fix an integer N and jX = {jX\ , . . . , jit*) satisfying fa > and £ ; /x,- = N. Then the direct product ^ N 
realizes L = (^) independent copies of (T[,- $i , Hi m f ' > Hi ' ) (the key is that now these are all the same 
size). Applying Corollary 15.41 we find that symmetric powers of direct powers of ^ prove the bound 

QriM ,i * /3 </'. (5.2) 

Summing this inequality over all /I gives 

and the theorem follows by taking Af-th roots and letting ,/V go to infinity. Note that for each N, by an 
averaging argument, there must be a particular distribution jx for which the left hand side of (15.21 ) is at least 

(Hi(^i m i n i) w ^ 3 ) I ( N ~k-i l ) an d this is a concrete sequence of coherent configurations that prove the same 
bound (in the limit). □ 

The results of this section are not specific to coherent configurations. Given any algebra A, the analogous 
construction is to look at the subalgebra of A®" invariant under the action of S n . 

Before using Theorem l5.5l to obtain bounds on ft), we briefly contrast other proofs of the asymptotic sum 
inequality with the above proof, which seems structurally different as we now explain. The standard proof 
of the asymptotic sum inequality takes a tensor T realizing Q) k =l ((i,mi,nj) and finds k\ independent copies 
°f {Yli^i^Yli m hHi n i) m T® k . By performing block matrix multiplication, these are capable of realizing 
the larger matrix multiplication instance (K ■ W^li^K ■ T[, ntj,K ■ ]T, ij) (where K m k\ l / a ), and the general 
bound follows after some manipulations analogous to our Corollary 15.41 and Theorem 15.51 In contrast, our 
proof finds a single copy of (S\i(-i,Y\i m iY\i n i) m T® k , and then uses the fact that T has special structure — it 
is the structural tensor of an algebra — to argue that the same matrix multiplication instance survives after 
symmetrizing the &-th power. Symmetrizing reduces the rank, and thus the s-rank actually shrinks enough 
to obtain the same bound. We know of no other proof that works by shrinking the rank (including our proof 
in (6) for independent matrix multiplications realized in group algebras). 
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5.1 Nontrivial bounds on co 

Using Theorem [53J we can convert all of the results of [6 ] into realizations of a single matrix multiplication 
tensor in a commutative coherent configuration, namely a symmetric power of an abelian group. While the 
starting constructions are not new, the final algorithms are (they use machinery introduced in this paper). 
They establish that commutative coherent configurations suffice to prove nontrivial bounds on ft), and even 
point to a specific family of commutative coherent configurations that we conjecture is capable of proving 
CO = 2. 

Theorem 5.6. There exist commutative coherent configurations that prove s-rank exponent bounds co s < 
2.48, C0 S < 2.41, and C0 S < 2.376, and thus corresponding exponent bounds CO < 2.72, CO < 2.62, and CO < 
2.564, respectively. 

Proof. Apply Theorem l5.5l to the abelian group constructions of Proposition 3.8 in [6], Theorems 3.3 and 6.6 
in J6j, and the generalization matching [8] (as stated in Q but not described in detail), respectively. Each 
of these constructions from [6], when viewing groups as coherent configurations and adopting the language 
of this paper, gives coherent configurations satisfying Definition 15.11 Apply Theorem 13.61 to the resulting 
s-rank exponent bounds to obtain the claimed bounds on CO. □ 

The specific exponent bounds cited above of course all suffer from the 50% penalty introduced by Theo- 
rem l3.6l But the numbers themselves should not obscure the main point, which is that matrix multiplication 
via coherent configurations is a viable approach to proving co = 2. Indeed, we conjecture that commutative 
coherent configurations are sufficient to prove co = 2: 

Conjecture 5.7. There exist commutative coherent configurations % 7 realizing (n,n,n) and of rank n 2+ °^\ 

Such a family of commutative coherent configurations would prove CO = 2. If Conjecture 3.4 or 4.7 
from [6] hold, then Conjecture !5.7l holds via Theorem 15.5 1 We note that recent work of Alon, Shpilka, and 
Umans [1] shows that Conjecture 3.4 from [6 ] contradicts a sunflower conjecture, although there is no strong 
consensus that this particular sunflower conjecture is true. Among the various combinatorial/algebraic con- 
jectures implying co = 2, Conjecture 15.71 is the weakest (it is implied by the others), which makes it the 
"easiest" among these potential routes to proving co = 2. 
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